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Shall t compare thee to a summer's day? 501 

thou art more lovely and mora temperate: 

Rough winds do shake the darting buds of May, 

And summer's tease hath all yfo short a date: /q — 502 

Sometime too hot the eye of heaven shines. 

And often is his ^eeAornpexton dimm 'dtf $0** * 503 

And every fair from fair sometime declines, . 

By chance or nature s changing course untrtmm 'd: 

But thy eternal summer sheB^e/not* " 504 

Nor lose possess/an of that fairthou owesr. 

Nor snail Death brag thou wender'st In his shade. 

Whan in eternal lines to time thou growest 

So long as men can breathe or eyes can see. 

So long Byes this and this gives life to thee. 



(57) Abstract: An electronically stored document which can be of any type such as text, image, drawing etc. is printed on a surface, 
preferably a sheet of paper, which is provided with a position-coding pattern. Manual editing is then carried out on the printout 
surface with a digital pen which comprises means for reading the position-coding pattern and also a pen point for marking on the 
surface. Editing is done by means of a code which is in the form of symbols from a predetermined set of symbols, on the sheet of 
paper. The editing information, i.e. the symbols applied to the surface, is digitally registered by the digital pen and transferred to the 
storage and processing device, preferably a computer. This transfer can be done directly during the editing or on a later occasion. 
Interpretation of the editing code is then carried out, wholly or partly in the computer, in interaction with the document stored in the 
computer, whereupon changes are made to the stored document in direct dependence on the interpretation. 




For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 
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PROCESSING OF DOCUMENTS 



TECHNICAL FIELD 

The invention relates to methods and devices intended for 
editing electronically stored documents. 

5 BACKGROUND 

US Patent Specification US-5,897,648 describes a device 
and a method for editing electronic documents. An f 
original document is scanned into a computer where an 
electronic version of the document is stored. The origi- 

10 * nal is then placed on an X/Y digitizing tablet and the 

position of the document on the digitizing tablet is cor- 
related with the scanned version of the document. Editing 
is . then carried out on the digitizing tablet with the aid 
of a digitizing pen coupled to the tablet. The editing is 

15 done in the form of markings on the original, the posi- 
tions of the markings being transferred via' the tablet to 
the computer. The editing markings are interpreted and 
converted into electronic form in the computer, after 
which the edited electronic document is displayed. 

20 The use of an invention according to US-5,897,648 has the 
very significant disadvantage that a user is forced to be 
located at the computer or at least at the digitizing 
tablet when editing. 

A general problem is thus how to provide for simple and 
25 flexible editing of electronic documents. 

SUMMARY OF THE INVENTION 

It is an object of the invention to address prob- 
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lems associated with the prior art. This object aim is 
achieved by a method and a computer program according 
to claim 1 and 2 below and a system according to claim 8 
and 9 . 

5 In its most general form, the invention is characterized 
in that, on the basis of an electronically stored 
document, which can be of any type such as text, 
image, drawing etc., the document is printed on a 
surface, preferably a sheet of paper, which is provided 

10 with a position-coding pattern. Manual editing is then 
carried out on the printout surface with a device which 
comprises means for reading the position-coding pattern 
and also a pen point for marking on the surface. Editing 
is done by means of a code which is in the form of sym- 

15 bols from a predetermined set of symbols, on the sheet of 
paper. Transferring of the editing information, i.e. the 
symbols and markings applied to the surface, is done to a 
storage and processing device, preferably a computer. 
This transfer can be done directly during the editing or 

20 on a later occasion. Interpretation of the editing code 
is then done, wholly or partially in the computer, in 
interaction with the document stored in the computer, 
whereafter changes are made to the, stored document in 
direct dependence on the interpretation. 

25 Although it is in many cases convenient to print the 

document information onto a pre-printed sheet on which 
position coding pattern already has been provided, it may 
be desirable to have an extra degree of freedom in that 
the document information is printed together with the 

30 position coding pattern. Such an aspect of the present 
invention is useful in situations where a user has the 
capability to calculate a position-coding pattern as will 
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be discussed in some detail below. 

The present invention allows for a plurality of users to 
edit one and the same document. By associating editing 
commands with timestamps and users, e.g. by way of 
5 identity codes associated with the reading devices, a 
sequence of editing commands can be interpreted by the 
computer which holds the electronic version of the 
document . 

A number of advantages of the invention, which are 
10 associated with simplicity of processing, are evident: it 
is simple and easy to understand, i.e. it is a question 
of intuitive processing of documents of the traditional 
type, i.e. paper printouts. This also results in a low 
learning threshold for the persons who are to carry out 
15 the editing. 

Furthermore, it is an advantage that it is simple to edit 
documents without the person editing needing to be 
located at a computer where the document is stored, or to 
be tied to a complicated input device which in the prior 
20 art is exemplified by a digitizing tablet. The editing 
information can thus be advantageously stored in the 
input device for subsequent transfer to the computer/ 
storage location. 

It is also advantageous to directly obtain a copy of the 
25 editing in the form of the manually edited printout as 
offered by the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 schematically shows an embodiment of a product 
which is provided with a position-coded pattern. 

Figs 2a- 2d schematically show how the symbols can 
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be configured in an embodiment of the invention. 

Fig. 3 schematically shows an example of 4x4 symbols 
which are used for coding a position. 

Fig. 4 schematically shows a device according to the 
5 present invention which can be used for position-determi- 
nation in three dimensions. 

Fig. 5a shows a printout of a text document with manually 
drawn editing instructions. 

Fig. 5b shows a printout of a drawing document with a 
10 manually drawn editing instruction. 

Fig. 5c shows a flow chart of a method according to the 
invention . 

Fig. 6 schematically shows an embodiment of a system for 
editing document information according to the present 
15 invention. 

PREFERRED EMBODIMENTS 

For the sake of clarity, the detailed description of the 
invention below has been divided into a number of part- 
descriptions. As an introduction, a coding pattern will 
be presented with reference to Figs 1, 2a-d and 3. This 

20 coding pattern represents position information which can 
be used in a method according to the invention. After 
presentation of the coding pattern, a device which is 
intended to be used in manual editing of a printed docu- 
ment is presented in connection with Fig. 4. The device, 

25 which is pen-shaped, reads the position-coding pattern 

and where applicable also text and is provided with a pen 
point to make editing information on the printed document 
visible. After that is shown, with reference to Figs 5a 
and 5b, how examples of manual editing information are 
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drawn on a printout of a text document (Fig. 5a) and a 
document (Fig. 5b) which contains a drawing figure. Then, 
a method and system for editing document information is 
presented with reference to Fig. 5c and Fig. 6. 

5 The position-coding pattern and the reading device 

illustrated in Figs 1-4 below are further described in 
applicant's international patent publication WO 01/16691, 
as well as in applicant's international patent 
applications PCT/SEOO/01895 and PCT/SE00/01897 , all of 
10 which are incorporated herein by reference. 

Fig. 1 shows a part of a product in the form of a sheet 
of paper 1 which is provided on its surface 2 with an 
optically readable position-coding pattern 3 enabling 
position-determination to be carried out. The position- 

15 coding pattern consists of symbols 4 which are systema- 
tically arranged over the surface 2 so that it has a 
"patterned" appearance. The sheet of paper has an x coor- 
dinate axis and a y coordinate axis. In this case, posi- 
tion determination can be carried out on the entire sur- 

20 face of the product. In other cases, the surface which 
allows position determination may consist of a smaller 
part of the product. For example, the sheet of paper can 
be used for producing an electronic representation of 
information which is written or drawn on the surface. The 

25 electronic representation can be produced by continuously 
determining the position of the pen on the sheet of paper 
by reading the position-coding pattern while writing on 
the surface with a pen. 

The position-coding pattern comprises a virtual raster 
30 which is thus neither apparent to the human eye nor can 

it be detected directly by a device which is to determine 
positions on the surface, and a plurality of symbols 4 
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each of which can assume one of four values M l"-M H as 
described in the text which follows. In this connection, 
it should be pointed out that the position-coding pattern 
in Fig. 1 has been greatly enlarged for the sake of 
5 clarity. Moreover, it is only shown on a part of the 
sheet of paper. 

The position-coding pattern is arranged in such a manner 
that the position of a partial surface on the writing 
surface is coded by the symbols on this partial surface. 

10 A first and a second partial surface 5a, 5b are shown by 
dashed lines in Fig. 1. The part of the position-coding 
pattern (in this case 3x3 symbols), which is located on 
the first partial surface 5a, codes a first position, and 
the part of the position-coding pattern which is located 

15 on the second partial surface 5b codes a second position. 
The position-coding pattern is thus partly common to the 
adjoining first and second positions. Such a position- 
coding pattern is designated as "floating" in this 
application. 

20 Figs 2a-d show an embodiment of a symbol which can be 
used in the position-coding pattern according to the 
invention. The symbol comprises a virtual raster point 
6 which is represented by the intersection between the 
raster lines, and a marking 7 which has the form of a 

25 dot. The value of the symbol depends on where the mark- 
ing is placed. In the example in Fig. 2, there are four 
possible placements, one on each one of the raster lines 
which extend from the raster points. The displacement 
from the raster point is equal for all values. In the 

30 text which follows, the symbol has the value 1 in 

Fig. 2a, the value 2 in Fig. 2b, the value 3 in Fig. 2c 
and the value 4 in Fig. 2d. In other words, there are 
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four different types of symbols. 

Each symbol can thus represent four values "1-4". This 
means that the position-coding pattern can be divided 
into a first position code for the x coordinate and a 
5 second position code for the y coordinate. The dividing 
is done as follows: 



Symbol value 


x code 


y code 


1 


! 1 


1 


2 


0 


1 


3 


1 


0 


4 


0 


0 



The value of each symbol is thus translated into a first 
digit, in this case bit, for the x code and a second 
10 digit, in this case bit, for the y code. In this manner, 
two completely independent bit patterns are obtained. The 
patterns can be combined into a common pattern which is 
coded graphically with the aid of a plurality of symbols 
according to Fig. 2. 

15 Each position is coded with the aid of a plurality of 

symbols. In this example, 4x4 symbols are used for coding 
a position in two dimensions, i.e. an x coordinate and a 
y coordinate. 

The position code is built up with the aid of a number 
20 series of ones and zeros which has the characteristic 
that no sequence of four bits occurs more than once in 
the series. The number series is cyclic, which means 
that the characteristic also applies when the end of the 
series is coupled together with its beginning. A sequence 
25 of four bits thus always has an unambiguously determined 



# • 

WO 01/71475 PCT/SE01/00605 

8 

position in the number series. 

The series can have a maximum length of 16 bits if it is 
to have the characteristic described above for sequences 
of four bits. In this example, however, only a seven-bit- 
5 long series is used as follows: 

"0 0 0 1 0 1 0" 

This series contains seven unique sequences of four bits 
which code a position in the series as follows: 



Position in the series 


Sequence 


0 


0001 . 


1 


0010 


2 


0101 


3 


1010 


4 


0100 


5 


1000 


6 


0000 



10 

For coding the x coordinate, the number series is written 
sequentially in columns over the entire surface which is 
to be coded. The coding is based on the difference or 
position displacement between numbers in adjoining 

15 columns. The magnitude of the difference is determined by 
the position in the number series at which one allows the 
column to begin (i.e. with which sequence) . More 
specifically, taking the difference modulo seven between, 
on the one hand, a number which is coded by a four-bit 

20 sequence in a first column and which thus can have the 
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value (position) 0-6, and, on the other hand, 
a corresponding number (i.e. the sequence at the same 
"level") in an adjoining column, the result will be the 
same independently of where along the two columns the 
5 comparison is made. It is thus possible to code an 
x coordinate which' is constant for all y coordinates 
with the aid of the difference between two columns. 

Since each position on the surface is coded with 

4x4 symbols in this example, three differences (having 

10 the value 0-6) according to the above are available for 
coding the x coordinate. The coding is then carried out 
in such a manner that the three differences will always 
have the value 1 or 2 and the other two will have values 
within the range of 3-6. Thus, no differences may be zero 

15 in the x code. In other words, the x code is structured 

in such a manner that the differences will be as follows: 

(3-6) (3-6) (1-2) (3-6) (3-6) (1-2) (3-6) (3-6) (1-2)... 
Each x coordinate is thus coded with two numbers between 
3 and 6 and a subsequent number which is 1 or 2. 
20 Subtracting three from the high numbers and one from the 
low one provides a number in mixed base which directly 
yields a position in the x direction from which the x 
coordinate can then be determined directly as shown in 
the example below. 

25 Using the principle described above, x coordinates 

0,1,2... can thus be coded with the aid of numbers which 
represent three differences. These differences are coded 
with a bit pattern which is based on the number series 
above. Finally, the bit pattern can be coded graphically 

30 with the aid of the symbols in Fig. 2. 

In many cases, it will not be possible to obtain a 
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complete number which codes the x coordinate, but parts 
of two numbers, when reading 4x4 symbols. Since the least 
significant part of the number is always 1 or 2 , however, 
a complete number can be simply reconstructed. 

5 The y coordinates are coded according to the same 

principle as used for the x coordinates. The cyclic num- 
ber series is written repeatedly in horizontal rows over 
the surface which is to be position-coded. Exactly as 
in the case of the x coordinates, the rows are allowed 

10 to begin at different positions, i.e. with different 
sequences, in the number series. However, for the y 
coordinates, it is not differences which are used but the 
coordinates are coded with numbers which are based on the 
starting position of the number series in each row. Once 

15 the x coordinate for 4x4 symbols has been determined, it 
is possible to determine the starting positions in the 
number series for the rows which are included in the y 
code in the 4x4 symbols. In the y code, the most signi- 
ficant digit is determined by allowing it to be the only 

20 one which has a value in a specific range. In this exam- 
ple, a row of four is allowed to begin at position 0-1 
in the number series to indicate that this row relates 
to the least significant digit in a y coordinate, and the 
other three begin at position 2-6. In the y direction, a 

25 number series according to the following is thus found: 

(2-6) (2-6) 2-6) (0-1) (2-6) (2-6) (2-6) (0-1) (2-6)... 

Each y coordinate is thus coded with three numbers 
between 2 and 6 and a subsequent number between 0 and 1 . 

Subtracting 1 from the low number and 2 from the high 
30 ones provides, in a corresponding manner as for the x 
direction, a position in the y direction in mixed base 
from which the y coordinate can be determined directly. 
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Using the method above, 4 x 4 x 2 = 32 positions can be 
coded in the x direction. Each such position corresponds 
to three differences, providing 3 x 32 = 96 positions. 
Furthermore, it is possible to code 5x5x5x2 
5 = 250 positions in the y direction. Each such position 
corresponds to 4 rows, providing 4 x 250 = 1000 posi- 
tions. Altogether, it is thus possible to code .96,000 
positions. Since the x coding is based on differences, 
however, it is possible to select the position at which 

10 the first number series begins. Taking into account that 
this first number series can begin at seven different 
positions, it is possible to code 7 x 96,000 = 672,000 
positions. The starting position for the first number 
series in the first column can be calculated once the 

15 x coordinate has been determined. The above-mentioned 

seven different starting positions for the first series 
can code different sheets or writing surfaces on a pro- 
duct . 

To further illustrate the invention according to this 
20 embodiment, a specific example follows which is based on 
the embodiment of the position code described. 

Fig. 3 shows an example of an image with 4x4 symbols 
which are read by a device for position determination. 

These 4x4 symbols have the following values: 

25. 4 4 4 2 



These values represent the following binary x code and y 



3 2 3 4 



4 4 2 4 



13 2 4 



30 



code: 



m 
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x-code 



y-code 



0 0 0 0 



0 0 0 1 



10 10 



0 10 0 



0 0 0 0 



0 0 10 



5 



110 0 



10 10 



The vertical x sequences code the following positions in 
the number series: 2 0 4 6. The differences between the 
columns will be -2 4 2, which modulo 7 gives: 5 4 2 
which, in mixed base, codes position (5-3) x 8 + (4-3) x 

10 2 + (2-1) = 16 + 2 ■+ 1 s 19. Since the first coded x 

position is position 0, the difference which lies within 
the range 1-2 and which appears in the 4x4 symbols is the 
twentieth such difference. Since there are also a total 
of three columns for such difference and there is one 

15 start column, the vertical sequence farthest to the right 
in the 4x4 x code belongs to the 61st column in the x 
code (3 x 20 + 1 = 61) and the one farthest to the left 
belongs to the 58th. 

The horizontal y series codes the positions 0 4 1 3 in 
20 the number series. Since these series begin in the 58th 
column, the starting position of the rows is these 
numbers minus 57 modulo 7, which provides the starting 
positions 6 3 0 2. Translated into digits in mixed base, 
this becomes 6-2, 3-2, 0-0, 2-2 =4100, the third 
25 digit being the least significant digit in the number in 
question. The fourth digit is then the most significant 
digit in the next number. In this case, it must be the 
same as in the number in question. (The exception is when 
the number in question consists of the highest possible 
30 digits in all positions. It is then evident that the 
beginning of the next number is one greater than the 



WO 01/71475 PCT/SEOl/00605 

13 

beginning of the number in question.) 

In mixed base, the position of the four-digit number will 
be 0x50 + 4x10 + 1x2 + 0x1 = 42. 

The third row in the y code is thus the 43rd which has 
5 the starting position 0 or 1, and since there are a total 
of four rows on each such row, the third row is number 
43x4=172. 

Thus, the position of the topmost left corner for the 4x4 
symbol group is (58,170) in this example. 

10 Since the x sequences in the 4x4 group begin on row 17 0, 
the x columns of the entire pattern begin at positions 
{(2 0 4 6) -169) modulo 7 = 1 6 3 5 in the number series. 
Between the last starting positions (5) and the first 
starting positions, numbers 0-19 are coded in mixed base, 

15 and by adding up the representations of the numbers 0-19 
in mixed base, the total difference between these columns 
is obtained. A primitive algorithm for doing this is to 
generate these twenty numbers and directly add up their 
digits. The sum obtained is called s. The sheet or 

20 writing surface is then given by (5-s) modulo 7. 

In the example above, an embodiment has been described 
where each position is coded with 4x4 symbols and a 
number series with 7 bits is used. Naturally, this is 
only one example. Positions can be coded with more or 

25 fewer symbols. The number of symbols need not be the same 
in both directions. The number series can be of different 
length and does not need to be binary but may be based on 
another base. Different number series can be used for 
coding in the x direction and coding in the y direction. 

30 The symbols can have different numbers of values. 

In the example above, furthermore, the marking is a dot. 
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Naturally, it may have a different appearance. For 
example, it may consist of a line which begins at the 
virtual raster point and extends therefrom to a predeter- 
mined position. 

5 In the example above, the symbols are used within a 

square partial surface for coding a position. The partial 
surface can have a different shape, for example hexago- 
nal. The symbols do not need to be arranged in rows and 
columns at an angle of 90 degrees to each other either, 
10 but can also be arranged in some other manner. 

For the position codes to be detected, the virtual raster 
must be determined. This can be done by studying the 
distance between different markings. The shortest 
distance between two markings must originate from two 

15 adjoining symbols with the value 1 and 3 so that the 

markings are lying on the same raster line between two 
raster points. When such a pair of markings has been 
detected, the associated raster points can be determined 
with knowledge of the distance between the raster points 

20 and the displacement of the markings from the raster 

points. Once two raster points have been located, addi- 
tional raster points can be determined with the aid of 
measured distances to other markings and with knowledge 
of the relative distance of the raster points. 

25 An embodiment of a device for position determination, 
whose spatial relationship to a surface can be 
determined, is shown schematically in Fig. 4. It com- 
prises a casing ll, which is approximately shaped like a 
pen. In the short end of the casing, there is an opening 

30 12. The short end is provided to bear against or to be 
held at a short distance from a surface S on which the 
position determination is to occur. In the figure, a nor- 
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mal direction v : to the surface S and an axis A extending 
through the device are indicated. In use of the reading 
device, axis A can form an angle of inclination 0 with 
the normal direction v. . 

5 The casing mainly contains an optical part, an electronic 
part and a power supply. 

The optical part comprises at least one light-emitting 
diode 13 for illuminating the surface which is to be 
imaged, and a light-sensitive area sensor 14, for example 
10 a CCD or CMOS sensor, for registering a two-dimensional 
image. The device may also comprise a lens system (not 
shown) . 

The power supply for the device is obtained from a 
battery 15 which is mounted in a separate compartment in 

15 the casing. 

The electronic part contains image-processing means 16 
for determining a position on the basis of the image 
registered by means of the sensor 14 and more specifical- 
ly a processor unit with a processor which is programmed 

20 to read images from the sensor and to perform position 

determination on the basis of these images. Moreover, the 
processor unit may also store an identifier which is 
unique for each reading device. This device identifier is 
usually composed of a plurality of digits and/or 

25 characters, and can be used in coded form. The identifier 
is of use when performing the method according to the 
invention where a user is identified, by the device 
identifier, as a particular editor of a document. 

In this embodiment also, the device comprises a pen point 
30 17, with the aid of which it is possible to write normal 
pigment-based writing on the surface on which the 
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position determination is to occur. The pen point 17 can 
be retracted and extended so that the user can control 



point 17 may be non-retractable and covered by a cap (not 
5 shown) when not in use. In certain applications, the 
device does not need to have a pen point at all. 

The device also comprises buttons 18, with the aid of 
which the device is activated and controlled. It also has 
a transceiver 19 for wireless transmission, e.g. by means 
10 of IR light or radio waves, of information to and from 

the device. The device can also comprise a display 20 for 
showing positions or registered information. 

Applicant's international patent publication WO 98/20446 
describes a device for registering text. This device can 
15 be used for position determination if it is programmed in 
a suitable manner. If it is to be used for pigment-based 
writing, it must also have a pen point. 

The device can be divided into different physical 
casings, a first casing containing components which are 
2 0 necessary for obtaining images of the position-coding 
pattern and for transferring these to components which 
are located in a second casing and which carry out the 
position determination on the basis of the image or 
images regi s tered . 

25 As mentioned, the position determination is done by a 

processor which thus must have software for locating and 
decoding the symbols in an image and for determining 
positions from the codes thus obtained. A person skilled 
in the art can design software on the basis of the above 

30 example, which carries out position determination on the 
basis of an image of a part of a position-coding pattern. 



whether or not it is to be used. Alternatively, the pen 
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Furthermore, the person skilled in the art can design 
software on the basis of the above description, for 
printing the position-coding pattern. 



In the embodiment above, the raster is a rectangular 
5 grid. It can also have other forms, i.e. non-rectangular. 



cyclic number series which is used. This provides 

a certain redundancy which can be used, for example, for 

checking the turning of the read group of symbols. 

10 In the embodiment above, the pattern is optically 

readable and the sensor thus is an optical sensor. It 
should be emphasized that other position-coding patterns 
could be used within the scope of the present invention, 
for example the pattern described in applicant's 

15 international patent publication WO 00/01670, or the 

prior art position-coding patterns as disclosed in US-A-5 
051 736, WO 00/31682 and EP-A-0 469 864. Further, the 
pattern could be based on another parameter than an 
optical parameter. Naturally, in that case, the sensor 

20 must be of a type which can read the parameter in 
question. Examples of such parameters are chemical, 
acoustic or electromagnetic symbols. Also capacitive or 
inductive symbols can be used. 

Fig. 5a shows a printout 501 of a text document which is 
25 preferably stored in a computer. The printout 501 is 

suitably done on a sheet of paper, the surface of which 
is provided with a position-coding pattern as described 
above in connection with Figs 1-3. For the sake of 
clarity, however, no such pattern is shown in Fig. 5a. 

30 In one embodiment of the invention, the digital pen of 
Fig. 4 is used for providing editing information on the 



In the embodiment above, it is not the longest possible 



# 
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printout 501- Such editing information is schematically 
exemplified in Fig. 5a at reference numerals 502, 503 and 
504. A misspelt word "two", the wrong letter "w" of which 
has been provided with a tilted line and has been marked 
5 in the right-hand margin that it is to be replaced by the 
letter "o" 502. An incorrect word "green" has been 
stricken through with a horizontal line and has been 
marked in the right-hand margin that it is to be replaced 
by the word "gold" 503. The words "fade" and "not" have 
10 been marked 504 with an editing symbol which, on inter- 
pretation, is to indicate that the words are to change 
places with one another. 

Fig. 5b very schematically shows a drawing consisting of 
simple geometric figures. A cross marking 505 has been 
15 drawn on one side of a rectangle in order to indicate 
that the side is to be erased. 

A method for performing editing according to the 
invention, and with reference to the example of figure 
5a, is illustrated in figure 5c. 

20 In a read and search step 510, the text of the document 
is analyzed in that each letter is associated with its 
position and at the same time a search for editing 
symbols with corresponding positions is performed. Then, 
in a number of decision steps 511,513,515,517 the editing 

25 symbols are identified and corresponding interpretation 
steps 512,514,516,518 are performed. 

In the read and search step 510, the identity of the 
digital pen is also determined in that a transfer of a 
unique device identifier is performed from the digital 
30 pen to the means for storing the document, typically a 

memory unit in a computer or server. A particular digital 
pen may be associated with a particular user, i.e. editor 
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or reviewer of the document. If several editors, each 
with a digital pen having a unique device identity, make 
corrections to the text, these corrections may then be 
associated with the different users. 

5 If the editing symbol of step 511 is found, a 

corresponding editing symbol is searched for in the 
margin area of the printed document as well as any 
handwritten text close to that editing symbol. Such text 
is interpreted using ICR- technique and the interpreted 
10 text is then inserted at the appropriate location in the 
stored document . 

If the editing symbol of step 513 is found, the text in 
the stored document which is located at the same position 
as the editing symbol is removed from the stored 
15 document. 

If the editing symbol of step 515 is found, a 
corresponding editing symbol is searched for in the 
margin area of the printed document as well as any 
handwritten text close to that editing symbol. Such text 
20 is interpreted using ICR- technique and the interpreted 

text is then inserted at the appropriate location in the 
stored document, replacing the letter at the position of 
the editing symbol in the stored text. 

If the editing symbol of step 517 is found, one or more 
25 letters at the position of the left part, i.e. within the 
left "loop", of the editing symbol is identified. Then 
one or more letters at the position of the right part of 
the editing symbol is identified, whereupon the 
identified text from the left part is moved to the 
30 identified position at the right part of the editing 
symbol, and vice versa. 
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From the above it is understood that each editing symbol 
results in an editing command being generated, either in 
the pen itself or in a computer unit that communicates 
with the pen and comprises software for identifying 
5 editing symbols. 

As discussed above, it is in many cases convenient to 
print the document information onto a pre-printed sheet 
on which position-coding pattern already has been 
provided. However, it may be desirable to have an extra 

10 degree of freedom in that the document information is 

printed together with the position-coding pattern. Such 
an aspect of the present invention is useful in 
situations where a user has the capability to calculate a 
position-coding pattern and apply it to the sheet to be 

15 printed. Moreover, as discussed briefly above, the 

present invention allows for a plurality of editors to 
edit one and the same document. By associating editing 
commands with timestamps and users, e.g. by way of unique 
identity codes associated with the digital pens, a 

20 sequence of editing commands can be interpreted by the 
computer which holds the electronic version of the 
document . 

It is to be understood that the editing symbols and 
markings shown in Figs 5a, 5b and 5c only should be seen 

25 as examples of how editing information can be configured. 
The editing symbols can be a subset of a larger set of 
symbols comprising more or less complicated indications 
of how the subsequent interpretation should be carried 
out and how the real changes of the stored document are 

30 to appear. The corresponding set of editing commands can 
be determined in advance or be generated by, for example, 
a user through a suitable learning process according to 
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the prior art technique. 

Fig. 6 shows a system that can be used in carrying out 
the method described above. The system includes a 
plurality of pen-shaped reading devices 601, a central 
5 unit 602, a local processing unit 603, and a printer unit 
604. The reading devices 601 correspond to the digital 
pen shown in Fig. 4 and are arranged for wireless 
communication with the central unit 602, for example 
directly via a telecommunications network, or indirectly 

10 via short-range communication to a modem unit (not 

shown) , such as a mobile phone, a personal computer, a 
Bluetooth* node etc, which in turn connects to the 
central unit 602 via a suitable network, for example the 
Internet, a telecommunications network, a LAN etc. 

15 Likewise, the central unit 602 is arranged for 

communication with the local processing unit 603, 
typically a computer device such as a personal computer, 
in which the electronic document to be annotated is 
created. As will be further described below, the central 

20 unit acts, inter alia, as a pattern administration unit. 
The communication between the local processing unit 603 
and the central unit 602 can be handled by a messaging 
service, such as e-mail, if direct communication is 
unavailable. Further, the local processing unit 603 is 

25 arranged to communicate with a printer unit 604. 

After having created a document in the local processing 
unit 603, the author registers the document with the 
central unit 602. In this process, the central unit 602 
receives from the local processing unit 603 a file 
30 identifier and data on the number of standard pages of 

the document to be registered. Alternatively, the central 
unit 602 receives an electronic copy of the document. In 
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the central unit 602, the pages of the electronic 
document are assigned a corresponding number of pattern 



pages, i.e. mutually unique subsets of the above- 
described position-coding pattern. After registration, a 
5 the original document, or a copy thereof, is "locked* to 



processing unit 603 or the central unit 602. 

Then, the author distributes the thus- locked document to 
different reviewers. The author can send the electronic 

10 document from the local processing unit 603 to the 
printer unit 604 and then physically distribute the 
printouts, or distribute the document electronically so 
that the reviewers can print the document on any nearby 
printer units (not shown) . Alternatively, the different 

15 reviewers might themselves download the document from the 
central unit to a respective computer, from which the 
document can be sent to a suitable printer unit. 

Thereafter, each reviewer uses his reading device 601 to 
write on his printout 605, wherein the reading device 601 

20 electronically registers the positions- where it is 

applied to the printout, thereby producing a digital copy 
of editing information written on the pages of the 
)printout. When a reviewer is finished with his review, he 
synchronizes his reading device 601 v with the central unit 

25 602. In this process, the digital editing information, 
i.e. position data read by the reading device 601, is 
sent to the central unit 602 together with a reading 
device identifier, and optionally timestamps indicating 
when the annotations were made. The synchronization can 

30 be effected, for example, by the reviewer checking a send 
icon (not shown) on the printout 605, the send icon being 
provided with a specific part of the position-coding 



prevent further manipulation and is stored on the local 
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pattern. When the processor unit of the reading device 
601 registers one or more positions coded by this 
specific part of the pattern, it initiates the 
synchronization. Alternatively, the reviewer can operate 
5 a button on the reading device 601 to initiate the 

synchronization. As a further alternative, the digital 
editing information can be sent to the central unit 602 
in real time, i.e. while the reviewer is actually writing 
the editing information on the printout 605. 

10 Upon completed synchronization with one or more reading 

devices 601, the central unit 602 issues a message to the 
local processing device 603, whereupon the author can 
connect to the central unit 602 to download the feedback 
from the reviewers, one or more at a time. The central 

15 unit 602 also translates the editing information to local 
positions on each page of the electronic document, so 
that the local processing unit 603 can incorporate the 
editing information into the electronic document to be 
displayed to the author. In the case where a copy of the 

20 electronic document has been sent to the central unit 
602, the incorporation can be effected by the central 
unit 602 itself which then transmits an electronic file 
back to the local processing unit 603 for display to the 
author. 

25 In an alternative embodiment (not shown) , the pattern 
administration functionality of the central unit is 
incorporated into the local processing unit, so that one 
and more reading devices communicate with the local 
processing unit, typically a personal computer, a PDA or 

30 the like. 

In another alternative embodiment (not shown) , the 
central unit only serves the function of assigning 
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pattern pages to the electronic document, i.e. the local 
processing unit receives a file with the pattern pages, 
or parameters for calculating the same, from the central 
unit. The local processing unit then communicates with 
5 the digital pens and produces an updated document based 
on the received editing information. 

In a further embodiment, the digital pen is capable of 
interpreting the editing symbols, so that the pen can 
transmit an editing command to the local processing unit. 
10 Optionally, the pen is also capable of effecting an ICR 
analysis of relevant parts of the editing information 
written on the printout. 

Although the author and the reviewers have been described 
as separate individuals, it should be evident that in the 
15 method and system described above the author act as a 
reviewer as well. It is also to be understood that the 
central unit can communicate with a plurality of local 
processing units, to thereby act as a hub in an 
infrastructure for handling information. 

20 It should also be noted that the incorporation of the 
editing information might or might not include 
interpreting the markings made by the reviewers on the 
sheet 605 containing the printed text. In some reviewing 
work, it may be desirable to enable for one or more 

25 reviewers to simply annotate the text, in the margins for 
example, and to associate those annotations with specific 
positions within the text and to enable an owner of the 
document to view the text together with the annotations. 
Thereby, instead of being forced to edit part of the text 

30 or graphics on the printout, the reviewer is allowed to 
write brief comments or draw sketches in the margins of 
the document to aid the author in his further drafting of 
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the document. In this case, after review, the document 
information of the updated electronic document includes 
the original text and the handwritten annotations made by 
the reviewers. It is to be appreciated that the reviewer 
5 can be allowed to use both annotations and editing 

symbols/markings in one and the same document. This can 
be achieved, for example, by using a specific set of 
annotation symbols which identifies a piece of editing 
information as an annotation. 

10 The local processing unit 603 suitably includes 

presentation software which can be arranged to present 
the annotations in the form of, e.g., pop-up windows or 
the like overlaid on the original document. By 
associating different users, via the device identifier, 

15 with the different annotations it is possible to include 
functions in the presentation software which, e.g., 
presents the comments of the annotators one at a time. 

It should also be noted that the presentation software 
could be set to prompt the author for approval before 
20 inserting any interpreted text associated with an editing 
symbol into the electronic document. 

In the context of the invention, especially when allowing 
for annotations, it might be of importance to anchor the 
editing information to specific positions within the 

25 document, more specifically to specific portions of the 
text, such as chapters, paragraphs, lines or single 
words. When the author starts editing the original 
document based on the editing information, the overlaid 
handwritten comments must be maintained in synch with 

30 their original position. This is achieved by anchoring 
the annotations to the text, for example via an agreed 
set of annotation symbols which associates a comment 
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written in the margin of the document with a portion of 
the text in the document. Such a symbol may be of any 
kind, for example as discussed in connection with figures 
5a- 5c above. 

5 The different steps described above is suitably performed 
by software running on the units 602, 603 and devices 601 
of the system. This software could be contained in the 
system or distributed to the system on one or more 
computer readable media, for example a volatile memory or 

10 a nonvolatile memory such as a floppy diskette or CD-ROM. 
The software could also be distributed on computer 
readable media in the form of propagated signals, such as 
the stream of bits that represent Internet transmissions 
of packets or the carrier waves that are transmitted to 

15 satellites. 
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CLAIMS 

1. A method for editing document information in a 
computer- stored document comprising: 

- transferring the document information of the 
5 document to a printing device which is capable of 

printing document information on a surface which is 
provided with a position-coding pattern, 

- receiving editing information from a reading 
device capable of reading position information from the 

10 position-coded surface, 

- interpreting the editing information, 

- changing the document information in dependence on 
the interpretation of the editing information, thereby 
producing an updated document. 

15 2 . A method for editing document information in a 
computer- stored document comprising: 

- transferring position-coding pattern information 
to a printing device which is capable of printing the 
position-coding pattern on a surface, 

20 - transferring the document information of the 

document to the printing device which is capable of 
printing document information on the surface, 

- receiving editing information from a reading 
device capable of reading position information from the 

25 position-coded surface, 

- interpreting the editing information, 

- changing the document information in dependence on 
the interpretation of the editing information, thereby 
producing an updated document. 

30 3. A method according to claim 1 or 2 , further comprising 
the step of receiving device identity information from 
the reading device, so as to associate the editing 
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information with a user of the reading device. 

4. A method according to claim 1, 2 or 3 , wherein the 
editing information is associated with a plurality of 
users each of which having generated at least one editing 

5 command with a reading device. 

5. A method according to claim 4, wherein the editing 
commands generated by the plurality of users are in an 
ordered sequence identified by at least a timestamp 
associated with each editing command. 

10 6. A method according to any one of claims 1-5, wherein 
the editing information comprises position information 
related to the position of the reading device on the 
surface, and wherein the interpretation of the editing 
information comprises interpretation of the position 

15 information. 

7. A method according to claim 6, wherein the position 
information is in the form of sequences of coordinates 
which form manually generated curves which have 
correspondence in the form of drawn curves on the printed 

20 document. 

8. A method according to any one of claims 1-7, further 
comprising the step of displaying the document 
information of the updated document to a user. 

9. A method according to any one of claims 1-8, wherein 
25 the step of changing the document information includes 

adding editing information in the form of handwritten 
annotations to the computer- stored document. 

10. A method according to claim 9, comprising the step of 
associating, based on position information included in 

30 the editing information, each of said handwritten 

annotations with a respective portion of the document 
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information of the computer- stored document. 

11. A method according to any one of claims 1-10, wherein 
the step of changing the document information includes 
reformatting one or more parts of the document 

5 information. 

12. A method according to claim 11, wherein said 
reformatting includes adding text or graphics to said 
document information, removing text or graphics from said 
document information, or repositioning text or graphics 

10 included in said document information. 

13. A method according to claim 12, wherein the step of 
adding text includes converting part of the edizing 
information to machine- readable text. 

14. A method according to any one of claims 1-13, 
15 comprising the step of initially registering said 

computer- stored document in a pattern administration 
unit, wherein the pattern administration unit assigns a 
unique subset of said position-coding pattern to each 
page of said document. 

20 15. A computer readable-medium having embodied thereon a 
computer program which can be read by a computer and 
- which comprises instructions for causing a computer to 
execute the method according to one any of claims 1-14. 

16. A system for editing document information in a 
25 document, comprising: 

- storage means for storing the document, 

- means for transferring the document information of 
the document to a printing device which is capable of 
printing document information on a surface which is pro- 

30 vided with a position-coding pattern, 

- means for receiving editing information from a 
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reading device capable of reading position information 
from the position-coded surface, 

- means for interpreting the editing information, 

- means for changing the document information in 
5 dependence on the interpretation of the editing 

information, thereby producing an updated document. 

17. A system for editing document information in a 
document, comprising: 



10 - means for transferring position-coding pattern 

information to a printing device which is capable of 
printing the position-coding pattern on a surface, 

- means for transferring the document information of 
the document to the printing device which is capable of 
printing document information on the surface, 



reading device capable of reading position information 
from the position-coded surface, 

- means for interpreting the editing information, 

- means for changing the document information in 
dependence on the interpretation of the editing 
information, thereby producing an updated document. 

18. A system according to claim 16 or 17, further 
comprising means for receiving device identity 
information from the reading device, so as to associate 
the editing information with a user of the reading 
device. 

19. A system according to any one of claims 16-18, 
wherein said storage means is included in a computer 
device which is arranged to initially register said 
document in a pattern administration unit comprising a 
database of said position-coding pattern, said central 



- storage means for storing the document, 



- means for receiving editing information from a 
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unit being arranged to assign a unique subset of said 
position-coding pattern to each page of said document. 

20. A system according to claim 19, wherein said means 
for receiving editing information is included in said 

5 pattern administration unit. 

21. A system according to claim 19, wherein said means 
for receiving editing information is included in said 
local processing unit . 
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Shall I compare thee to a summer's day? 501 

Thou art more lovely and more temperate: 

Rough winds do shake the darling buds of May. 

And summer's lease hath all ty(o short a date: /q - — 502 

Sometime too hot the eye of heaven shines, 

And often is his-geeef&ompexion dimm'd;^ 9°^ " 503 

And every fair from fair sometime declines, 

By chance or nature's changing course untrimm'd; 

But thy eternal summer shall {ade/not^ " — 504 

Nor lose possession of that fair thou owest; 

Nor shall Death brag thou wander st in his shade. 

When in eternal lines to time thou growest: 

So long as men can breathe or eyes can see, 

So long lives this and this gives life to thee. 
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Fig. 5b 
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